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Abstract 

We define and study a new notion of "robust simulations" between complexity classes which 
is intermediate between the traditional notions of infinitely-often and almost-every where, as well 
as a corresponding notion of "significant separations". A language L has a robust simulation 
in a complexity class C if there is a language in C which agrees with L on arbitrarily large 
polynomial stretches of input lengths. There is a significant separation of L from C if there is 
no robust simulation of L e C. 

The new notion of simulation is a cleaner and more natural notion of simulation than the 
infinitely-often notion. We show that various implications in complexity theory such as the 
collapse of PH if NP = P and the Karp-Lipton theorem have analogues for robust simulations. 
We then use these results to prove that most known separations in complexity theory, such as 
hierarchy theorems, fixed polynomial circuit lower bounds, time-space tradeoffs, and the recent 
theorem of Williams, can be strengthened to significant separations, though in each case, an 
almost everywhere separation is unknown. 

Proving our results requires several new ideas, including a completely different proof of the 
hierarchy theorem for non-deterministic polynomial time than the ones previously known. 
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1 Introduction 



What does the statement "P 7^ NP" really tell us? All is says is that for any polynomial-time 
algorithm A, A fails to solve SAT on an infinite number of inputs. These hard-to-solve inputs 
could be exponentially (or much worse) far from each other. Thus even a proof of P 7^ NP could 
leave open the possibility that SAT or any other N P-complete problem is still solvable on all inputs 
encountered in practice. This is unsatisfactory if we consider that one of the main motivations of 
proving lower bounds is to understand the limitations of algorithms. 

Another important motivation for proving lower bounds is that hardness is algorithmically useful 
in the context of cryptography or derandomization. Again, if the hardness only holds for inputs 
or input lengths that are very far apart, this usefulness is called into question. For this reason, 
theorists developed a notion of almost-everywhere (a.e.) separations, and a corresponding notion of 
infinitely-often (i.o.) simulations. A language L is in i.o.C for a complexity class C if there is some 
A € C such that A and L agree on infinitely many input lengths. A class D is almost everywhere 
not in C if for some language L in D, L i.o.C, that is any C-algorithm fails to solve L on all 
but a finite number of input lengths. As an example of applying these notions, Impagliazzo and 
Wigderson |IW97) show that if E ^ SIZE(2°(")) then BPP is in i.o.P, and that if E ^ i.o.SIZE(2°(")), 
then BPP = P. 

However, the infinitely often notion has its own issues. Ideally, we would like a notion of 
simulation to capture "easiness" in some non-trivial sense. Unfortunately, many problems that we 
consider hard have trivial infinitely often simulations. For example, consider any NP-hard problem 
on graphs or square matrices. The natural representation of inputs for such problems yields non- 
trivial instances only for input lengths that are perfect squares. In such a case, the problem has 
a trivial infinitely often simulation on the set of all input lengths which are not perfect squares. 
On the other hand, the problem could be "padded" so that it remains non-trivial on input lengths 
which are not perfect squares. It's rather unsatisfactory to have a notion of simulation which is so 
sensitive to the choice of input representation. 

Not unrelated to this point is that analogues of many classical complexity results fail to hold 
in the infinitely often setting. For example, we do not know if SAT G i.o.P implies that the entire 
Polynomial Hierarchy has simulations infinitely-often in polynomial time. We also don't know if in 
general a complete language for a class being easy infinitely-often implies that the entire class is 
easy infinitely-often. This is true for SAT and NP because SAT is paddable and downward self- 
reducible, but for general complexity classes the implication is unclear. Given that even these basic 
analogues are not known, it's not surprising that more involved results such as the Karp-Lipton 
theorem |KL82| and the theorem of Impagliazzo, Kabanets and Wigderson |IKW02j don't have 
known infinitely often analogues either. 

In an ideal world, we would like all our algorithms to work on all input lengths, and all our 
separations to be almost-everywhere separations. While algorithm design does typically focus 
on algorithms that work on all input lengths, many of the complexity separations we know do 
not work in the almost everywhere setting. Separations proved using combinatorial or algebraic 
methods, such as Hastad's lower bound for Parity |Has86j or Razborov's monotone circuit lower 
bound for Clique [RazBSj tend to be almost everywhere (in an appropriate input representation). 
However, such techniques typically have intrinsic limitations, as they run into the natural proofs 
barrier |RR97] . Many of the lower bounds proved recently have come from the use of indirect 
diagonalization. A contrary upper bound is assumed and this assumption is used together with 
various other ideas to derive a contradiction to a hierarchy theorem. These newer results include 



1 



hierarchy theorems |Bar021 lFS04t lvMP06| . time-space tradeoffs |For001[FLvMV05] . and circuit lower 
bounds |BFT98t IVinOSl ISan07l IWillOal IWillObj . Unfortunately, none of these results give almost 
everywhere separations, and so the question immediately arises what we can say quantitatively 
about these separations, in terms of the frequency with which they hold. 

To address all these issues, we describe a new notion of "robust simulation" and a corresponding 
notion of "significant separation" . A language L is in r.o.C (robustly-often in C) if there is a language 
^ in C such that for every k there are infinitely many m and such that A and L agree on all inputs 
between m and m^. A class D has a significant separation from C if there is some L in D such that 
L r.o.C. This implies that for each L' E C, there is a constant k such that for each m, L and L' 
differ on at least one input length between m and m^. Intuitively, this means that if the separation 
holds at some input length, there is another input length at most polynomially larger at which the 
separation also holds, i.e., the hardness is not too "sparsely" distributed. 

Our definition of robust simulations extends the notion of uniform hardness of Downey and 
Fortnow |DF03] . A set A is uniformly hard in the sense of Downey and Fortnow \i A^ r.o.P. 

The notion of robust simulation is just slightly stronger than the notion of infinitely often 
simulation, and correspondingly the notion of significant separation is slightly weaker than that 
of almost everywhere separations. By making this tradeoff, however, we show that we can often 
achieve the best of both worlds. 

We give robustly often analogues of many classical complexity results, where infinitely often 
analogues remain open, including 

• NP C r.o.P implies PH C r.o.P 

• NP C r.o.SIZE(po/y) implies PH C r.o.P 

• NEXP C r.o.SIZE(po/y) implies NEXP C r.o.MA 

We then use these robustly often analogues together with other ideas to give several significant 
separations where almost everywhereseparations remain open, including 

• NTIME(n'^) 2 r.o.NTIME(n^), when r > s ^ 1 

• For each constant A;, II2P ^ r.o.SIZE(n'^) 

• SAT 2 r.o.DTISP(n°,polylog(n)) when a < \/2 

• NEXP 2 r.o.ACC° 

The robustly often notion gives us a cleaner and more powerful theory than the infinitely often 
notion. 



1.1 Intuition and Techniques 

To illustrate the advantages of the robustly often notion over the infinitely often notion, let's look 
at a simple example: trying to show that if SAT is easy, then all of NP is easy. Let L G NTIME(n'^) 
be any NP language, where > is a constant. SAT E i.o.P doesn't immediately imply L S i.o.P, as 
the range of the reduction from L to SAT might only intersect input lengths where the polynomial- 
time algorithm for SAT is incorrect. In this case, the problem can be fixed by padding the reduced 
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instance to polynomially many different input lengtlis and using downward self-reducibility to check 
YES answers for any of these inputs. However, this fix depends on specific properties of SAT. 

Showing that SAT G r.o.P imphes L G i.o.P is an easier, more generic argument. Define a 
robust set of natural numbers to be any set S such that for each k > there is an m for which 
S contains all numbers between m and m'^ for some m. SAT G r.o.P means that there is a robust 
set S on which the simulation works. Now the reduction from L to SAT creates instances of length 
n^polylog(n), and it's not hard to see that this automatically implies that composing the reduction 
with the algorithm for SAT gives an algorithm for L which works on some robust subset S' of S. 
This implies L G r.o.P. We call a robust subset of a set a robust refinement. Many of our arguments 
will involve defining a series of robust refinements of a robust set such that the desired simulation 
holds on the final refinement in the series, thus implying that the simulation goes through in the 
robustly often setting. 

Thus far, using robustly often seems easier but hasn't given us any additional power. The 
situation changes if we consider implications where the assumption is used two or more times. An 
example is the proof that NP C P implies PH C P - this is an inductive proof where the assumption 
is used several times. Trying to carry an infinitely often simulation through fails miserably in this 
setting because two infinitely often simulations do not compose - they might work on two completely 
different infinite sets of input lengths. 

Now two robustly often simulations do not in general compose either. It is not in general true 
that for complexity classes B, C and D, B C r.o.C and C C r.o.D, then B C r.o.D. However, we can 
get these two robustly often simulations to compose when they are both consequences of a single 
robustly often assumption. The robustly often assumption gives us some robust set to work with. 
If we're careful we can define a single robust refinement of this set on which B C C holds and so 
too does CCD, which implies BCD holds on this refinement as well. 

This is an idea that we will use again and again in our proofs. However, in order to use this 
idea, we need to be careful with the steps in our proof, as there are only some kinds of implications 
for which the idea is useful. For example, it works well with fixed polynomial-time reductions or 
translations with fixed polynomial advice, but not with exponential padding. More importantly, 
the idea only works when all the steps in the proof follow from a single assumption, so we need to 
re-formulate proofs so that they conform to this pattern. In some cases, eg. the proofs of Theorem 
[18] and Theorem 1241 the re-formulation is non-trivial and leads to proofs that are quite a bit more 
involved than the originals |IKW02l IKan82j . 

In the case of significant hierarchies for non-deterministic time, i.e., hierarchies where the lower 
bound is against robust simulations, the known techniques break down entirely. The traditional 
argument is a "chaining argument" |Coo72l ISFM781 Z83j which uses a chain of exponentially many 
input lengths and cannot possibly give a hierarchy against robustly often simulations. Here, we 
come up with a novel idea of chaining using witnesses to get a significant hierarchy for polynomial 
time. 

Our most technically involved result is that the recent breakthrough lower bound of Williams 
[WillOal IWillOb| can be strengthened to a significant separation. The proof of this result uses 
almost all of the techniques we develop, including the sophisticated use of robust refinements 
involved in proving Theorem [THl and a variant of the significant hierarchy for non-deterministic 
polynomial time. 

Implicit in our paper is a certain proof system for proving complexity class separations, such 
that any separation proved in this system automatically yields an infinitely often separation. It's 
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an interesting open problem to make this system explicit, and to study its power and its limitations 
more formally. 

2 Preliminaries 

2.1 Complexity Classes, Promise Problems and Advice 

We assume a basic familiarity with complexity classes such as P, RP, BPP, NP, MA, AM, S2,PP and 
their exponential-time versions. The Complexity Zoc0 is an excellent resource for basic definitions 
and statements of results. 

Given a complexity class C, coC is the class of languages L such that L S C. Given a function 
s : N — 7- N, SIZE(s) is the class of Boolean functions / = {fn} such that for each n, has Boolean 
circuits of size 0{s{n)). Given a language L and an integer n, Ln = L {0,1}'^. Given a class 
C, i.o.C is the class of languages L for which there is a language L' £ C such that Ln = L'^ for 
infinitely many length n. 

In order to deal with promise classes in a general way, we take as fundamental the notion of a 
complexity measure. A complexity measure CTIME is a mapping which assigns to each pair (M, x), 
where M is a time-bounded machine (here a time function tM{x) is implicit) and x an input, one of 
three values "0" (accept), "1" (reject) and "?" (failure of CTIME promise). We distinguish between 
syntactic and semantic complexity measures. Syntactic measures have as their range {0, 1} while 
semantic measures may map some machine-input pairs to "?". The complexity measures DTI ME 
and NTIME are syntactic (each halting deterministic or non-deterministic machine either accepts 
or rejects on each input), while complexity measures such as BPTIME and M ATI ME are semantic 
(a probabilistic machine may accept on an input with probability 1/2, thus failing the bounded- 
error promise). For syntactic measures, any halting machine defines a language, while for semantic 
measures, only a subset of halting machines define languages. 

A promise problem is a pair (y, A^), where Y,N <Z {0, 1}* and Y r\ N = 0. We say that a 
promise problem {Y,N) belongs to a class CTIME(t) if there is a machine M halting in time t on 
all inputs of length n such that M fulfils the CTIME promise on inputs in y U A^, accepting on 
inputs in Y and rejecting on inputs in A^. 

A language L is in CTIME(i)/a if there is a machine M halting in time t{-) taking an auxiliary 
advice string of length a(-) such that for each n, there is some advice string 6„, = a{n) such 
that M fulfils the CTIME promise for each input x with advice string 6„ and accepts x iff x E L. 

For syntactic classes, a lower bound with advice or for the promise version of the class translates 
to a lower bound for the class itself. 

Definition 1. Let S he a subset of positive integers. S is robust if for each positive integer k, there 
is a positive integer m ^ 2 such that n G S for all m ^ n ^ . 

Note that any robust set is infinite. We now define what it means to simulate a language in a 
complexity class on a subset of the positive integers. 

Definition 2. Let L he a language, C a complexity class, and S a subset of the positive integers. 
We say L £ Q on S if there is a language L' £ C such that Ln = L'n for any n € S. 

^http : //qwiki . caltech. edu/wiki/ComplexityZoo 
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Using the terminology of Definition [2l L G i.o.C for a language L and complexity class C if there 
is some infinite set 5 C N such that L G C on S*. We now define our main notion of robustly-often 
simulations. 

Definition 3. Given a language L and complexity class C, L £ r.o.C if there is a robust S such 
that L €z C on S. In such a case, we say that there is a robustly-often (r.o.) simulation of L in C. 
We extend this notion to complexity classes in the obvious way - given complexity classes B and C, 
B C r.o.C if there for each language L G B, L € r.o.C. IfB<^ r.o.C, we say that there is a significant 
separation of B from C . 

Clearly B C r.o.C implies B C i.o.C. Conversely, B ^ i.o.C gives a very strong separation of B 
and C, i.e., an almost-everywhere separation, while a significant separation is somewhat weaker but 
still much more significant than simply a separation of B and C. Intuitively, a significant separation 
means that input lengths witnessing the separation are at most polynomially far apart. 

We now define a sequence of canonical refinements for any given set S, which will play an 
important part in many of our proofs. 

Definition 4. Let S be a robust set. The canonical refinement Sd of S at level d is defined as 
follows for any integer d > 0; m £ iff m £ S and n £ S for all m ^ n ^ m'^ . 

It is easy to see S^, is robust if S is robust and that Sd C Sd> for d d'. 

3 Robust Simulations 

For any NP-complete language L the language 

L' = {xW G L I |x| + 1 + z is even} 

remains NP-complete but sits in i.o.P. In contrast if any NP-complete set under honest m-reductions 
sits in r.o.P then NP C r.o.P. 

Lemma 5. Let L and L' be languages such that L' reduces to L via a polynomial-time honest 
m-reduction. Let C be a complexity class closed under poly-time m-reductions. If there is a robust 
S such that L G C on S, then there is a robust refinement S' of S such that L' £ C on S' . 

Proof in appendix. 

The proof ideas of Lemma [5] can be used to show that robustly often analogues of various useful 
implications hold. We omit the proofs of these propositions, since they follow from the definition 
of robustly often in much the same way as Lemma El 

The first analogue essentially says that we can take a complete language to be representative of a 
complexity class, even in the context of robustly often simulations. It is an immediate consequence 
of Lemma [5j 

Proposition 6. //SAT G r.o.P, then NP C r.o.P. 

In fact, if SAT G P on S" for some robust set S and L G NTIME(n'^) for some integer d, the proof 
of Proposition [6] gives that L G P on Sd+i, i.e., on the canonical refinement of S at level d + 1. 

The next proposition says that translation arguments using a fixed polynomial amount of ad- 
vice carry through in the robustly often setting, for any "reasonable" complexity measure where 
"reasonable" means that the measure is closed under efficient deterministic transductions |vMP06] . 
All complexity measures considered in this paper are reasonable in this sense. 
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Proposition 7. Let BTIME and CTIME be any complexity measures closed under efficient de- 
terministic transductions. Let g and h be time-constructibe functions, and p a polynomial. If 
BTIME(5(n)) C r.o.CTIME(/i(n)), then BTIME(5(p(n))) C r.o.CTIME(/i(p(n))). 

As a consequence of Proposition [TJ we get for example that if NTIME(n) C r.o.P, then NP C 
r.o.P. There are contexts where exponential padding is used in complexity theory, eg., in the proof 
that NP = P implies NEXP = EXP. This result doesn't seem to translate to the robustly often 
setting, however a weaker version does. 

Proposition 8. If HP C r.o.P, then NEXP C i.o.EXP. 

The proposition below says that simulations of a syntactic class in another class can be translated 
to a simulation with fixed polynomial advice, even in the robustly often setting. 

Proposition 9. Let BTIME be a syntactic complexity measure and CTIME a complexity measure, 
such that both BTIME and CTIME are closed under efficient deterministic transductions. Let f and 
g be time-constructrible measures and p a polynomial. If BTIME(/(n)) C r.o.CTIME((7(n)), then 
BTIME(/(n))/p(n) C r.o.CT\U^{g{n + p{n)))/p{n). 

Theorem 10. //NP C r.o.P, then PH C r.o.P 

Proof in the appendix. 

Theorem 11. //NP C r.o.SIZE(po/y), then PH C r.o.SIZE(po/y) 

Theorem 12. //NP C r.o.BPP, then PH C r.o.BPP. 

We omit the proof of Theorem [TT| which closely resembles the proof of Theorem [TOl 
Next we show a robust analogue of the Karp-Lipton theorem |KL82| . We formulate a stronger 
statement which will be useful when we show significant fixed-polynomial circuit size lower bounds 
for The proof is simpler than for some of the other analogues, since the assumption is only 
used once during the proof. 

Lemma 13. If there is a constant k and a robust set S such that SAT € SIZE(n'^) on S, then there 
is a robust refinement S' of S such that U2SAT G S2 - TIME(n'=+i+°(i)). 

Proof in the appendix. 

The following is an immediate corollary. 

Corollary 14. //NP C r.o.S\ZE{poly), then C r.o.nf. 

Analogously, it is easy to show an robustly often version of a theorem credited to Nisan by 
Babai, Fortnow and Lund |BFL91]. We need the following lemma. 

Lemma 15. Let L be a language complete for E under linear-time reductions. If there is a robust 
set S and a constant k ^ 1 such that L E SIZE(n'^) on S, then there is a robust refinement S' of S 
such that L e MATIME(n2'=) on S' . 

The analogue of Nisan's result follows corollary. 

Corollary 16. //EXP C r.o.S\ZE{poly), then EXP C r.o.MA. 
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The following can be shown using the easy witness method of Kabanets [KabOll IIKW02j and 
known results on pseudo-random generators |NW94t IKvM99] . 

Lemma 17. Let R be any robust set and k > 1 be any constant. Then there is a robust refinement 
R' ofR such that either NE C DTIME(2""'"''' ) on R or MATIME(n^''') C NE/0(n) on R' . 

We next derive an robustly often analogue of the main theorem of Impagliazzo, Kabanets and 
Wigderson |lKW02j . 

Theorem 18. //NEXP C r.o.SIZE(poZy), then NEXP C r.o.MA. 

Proof in the appendix. 

4 Significant Separations 
4.1 Hierarchies 

The proofs of the hierarchies for deterministic time and space actually give almost-everywhere 
separations and therefore significant separations. 

For nondeterministic time the situation is quite different. Cook |Coo72| showed that NTIME(n^) C 
NTIME(n'') for any reals r < s. Seiferas, Fischer and Meyer |SFM78| gene ralize this result to show 
that NTH\/lE(ii(n)) C NTIME(i2(n)) for ti{n + 1) = o(t2(n)). Zak |^83) gives a simpler proof of 
the same result. All these proofs require building an exponential (or worse) chain of equalities to 
get a contradiction. Their proofs do not give almost everywhere separations or significant separa- 
tions. No relativizable proof can give an i.e. hierarchy as Buhrman, Fortnow and Santhanam give 
a relativized world that NEXP C i.o.NP. 

In this section we give relativizing proofs that NEXP ^ r.o.NP and that NTIME(n'') ^ r.o.NTIME(n*) 
for r > s ^ 1. The latter proof requires a new proof of the traditional nondeterministic time hier- 
archy. 

Theorem 19. NEXP ^ r.o.NP. 

Proof in appendix. Using similar ideas, we can get a separation against sub-polynomial advice. 

Theorem 20. NEXP ^ r.o.NP/n°(i) 

In the purely uniform setting, we now show a stronger version of Theorem [19] in the form of a 
significant hierarchy for non-deterministic polynomial time. 

Theorem 21. If ti and t2 are time- constructible functions such that 

• ti(n) = o{t2{n)), and 

• n ^ ti{n) ^ n'^ for some constant c 
then NTIME(t2(n)) ^ r.o.NTIME(ti(n)). 

Corollary 22. For any reals 1 ^ r < s, NTIME(n'') ^ r.o.NTIME(n''). 

Proof of Theorem\21\ Let Mi, M2, ... be an enumeration of multitape nondeterministic machines 
that run in time ti{n). 

Define a nondeterministic Turing machine M that on input VQV^Qw does as follows: 



7 



• If \w\ <ti{i + m + 2) accept if both Mi{V01'^OwO) and MiiVOl'^Owl) accepts. 

• If \w\ ^ ti{i + m + 2) accept if Mj(l*01™0) rejects on the path specified by the bits of w. 

Since we can universaUy simulate t(n)-time nondeterministic multitape Turing machines on an 
0(t(n))-time 2-tapenondeterministic Turing machine, L(M) e NTIME(0(ti(n+l))) C NTIME(t2(n)) 
Note (n + l)'^ = 0{n^) for any c. 

Suppose NTIME(t2(n)) C r.o.NTIME(ti(n)). Pick a c such that ti{n) < n^. By the definition of 
r.o. there is some no and a language L € NTIME(ti(n)) such that L{M) = L on all inputs of length 
between no and ng. Fix i such that L = L{Mi). Then z £ L{Mi) <^ z G L{M) for ah z = l*01"oOty 
for w ^ + no + 2). 

By induction we have Mi(l*01"oO) accepts if Mi(l*01"oOt(;) accepts for ah w ^ ti{i + uq + 2). 
So Mj(l*01"'"0) accepts if and only Mj(l*01"'''0) rejects on every computation path, contradicting 
the definition of nondeterministic time. □ 

4.2 Circuit Lower Bounds 

Kannan |Kan82] showed how to diagonalize in against circuit size almost everywhere, for 
any constant k. He combined this result with the Karp-Lipton theorem to obtain fixed polynomial 
circuit size lower bounds in Y^^. However, the lower bound for S2 no longer holds almost everywhere, 
as a consequence of the proof strategy used by Kannan. It has been open since then to derive an 
almost everywhere separation in this context. We manage to obtain a significant separation. We 
need a quantitative form of Kannan's original diagonalization result. Kannan's paper contains a 
slightly weaker form of this result, but his proof does yield the result below. 

Theorem 23. iKanS^ For any constant A; ^ 1, S4 - TIME(n3^) ^ i.o.SIZE(n'') 

Theorem 24. For each integer A; > 1, 2 r.o.SIZE(n'^). 

Proof in the appendix. 

Using similar ideas we can get robustly often analogues of the lower bound of Cai and Sengupta 
|Cai01] for S2P and Vinodchandran |Vin05j for PP: 

Theorem 25. For any k > 0, S2P 2 r.o.SIZE(n''). 

Theorem 26. For any k > 0, PP ^ r.o.SIZE(n'^). 

The following strong separation can be shown by direct diagonalization. 

Proposition 27. For any integer k ^ 1, DTIME(2" ) ^ i.o.SIZE(n'^). 

We use Proposition [27] to give an analogue of the result of Burhman, Fortnow and Thierauf 
|BFT98j that MAEXP ^ SIZE(poly) in the robustly often setting. We give a circuit lower bound 
for promise problems in MAEXP rather than languages. Intuitively, the fact that MAT I ME is a 
semantic measure causes problems in extending the proof of Buhrman, Fortnow and Thierauf to 
the robustly often setting; however, these problems can be circumvented if we consider promise 
problems. 

Theorem 28. Promise - MAEXP ^ r.o.S\ZE{poly). 
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Proof. Let Q be a promise problem complete for Promise — MAE under linear-time reductions. 
Assume, for the purpose of contradiction, that Promise — MAEXP C r.o.SIZE(po/y). Then there is a 
robust set 5 and an integer k > such that Q G SIZE(n'^) on S. Let L be a language complete for 
E under linear-time reductions. Since there is a linear-time reduction from L to Q, it follows that 
there is a robust refinement S' of S such that L E SIZE(n'^) on S. Using Lemma, there is a robust 
refinement S" of S' such that L £ MATIME(n^'^) on S". Using a simple padding trick, there is a 
robust refinement S'" of S" such that for each language L' E DTIME(2""'), L' £ MATIME(n'''=') on 
S'". Using completeness of Q again, there is a robust refinement S"" of S'" such that L' G SIZE{n'') 
on S"" for any L' G DTIME(2"- ), which contradicts Proposition [271 □ 

Our most technically involved result is that the recent lower bound of Williams jWillOb] that 
NEXP 2 ACC'' extends to the robustly often setting. His proof uses the nondeterministic time 
hierarchy and the proof of Impagliazzo, Kabanets and Wigderson |IKW02| . neither of which may 
hold in the infinitely-often setting. So to get a robustly-often result we require variants of our 
Theorems [21] and [181 To save space, we will focus on the new ingredients, and abstract out what 
we need from Williams' paper. 

We first need the following simultaneous resource-bounded complexity class. 

Definition 29. NTIMEGUESS(T(n), (^(n)) is the class of languages accepted by NTMs running in 
time 0{T{n)) and using at most 0{g{ri)) non- deterministic hits. 

We have the following variant of Theorem [21] which has a similar proof. 

Lemma 30. For any constant k, NTIME(2") ^ r.o.NTIMEGUESS(2"/n, n'^). 

We also need the following robustly often analogue of a theorem of Williams [WillOa) . which 
uses the proof idea of Theorem [18] The problem SUCCINCT3SAT is complete for NEXP under 
polynomial-time m-reductions. 

Lemma 31. // NE C r.o.ACC'^ on S for some robust set S, then there is a constant c and a 
refinement S' of S such that SUCCINCT3SAT has succinct satisfying assignments that are ACC^ 
circuits of size n'^ on S' . 

Proof. The proof of Theorem 1181 gives that if NE C ACC" on S, then there is a constant d and 
a robust refinement R of S such that SUCCINCT3SAT has succinct satisfying assignments that 
are circuits of size n"^ on R. Since P C ACC° on S and using Proposition [9] we get that there is 
a constant c and a robust refinement S' of R such that SUCCINCT3SAT has succinct satisfying 
assignments that are ACC'^ circuits of size n'^ on S'. □ 

Now we are ready to prove the robustly often analogue of Williams' main result |WillOb| . 
Theorem 32. NEXP ^ r.o.ACC°. 

Proof Sketch. Assume, to the contrary, that SUCCINCT3SAT G ACC'^ on R for some robust 
R. By completeness of SUCCINCT3SAT, it follows that there is a robust refinement S oi R and 
a constant k' > 1 such that NE has ACC° circuits of size n'^ . Let L G NTIME(2"') but not in 
r.o.NTIMEGUESS(2"'/n, n'^), where k will be chosen large enough as a function of k'. Existence 
of L is guaranteed by Lemma [30l We will show L G r.o.NTIMEGUESS(2"'/n, n'^) and obtain a 
contradiction. 
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The proof of Theorem 3.2 in Wihiams' paper gives an algorithm for determinining if x G L. 
The algorithm non-deterministically guesses and verifies a "small" (size n*^^'^^) ACC'^ circuit which 
is equivalent to the SUCCINCT3SAT instance to which x reduces, within time 2'^/uj{n) by using 
Williams' new algorithm for ACC^-SAT together with the assumption that NEXP and hence P in 
ACC*^ on S. This guess-and-verification procedure works correctly on some robust refinement of S. 
Then, the algorithm uses the existence guarantee of Lemma[3T]to guess and verify a succint witness, 
again using Williams' algorithm for ACC'^-SAT. This further guess-and-verification procedure works 
correctly on some further robust refinement S" of S. In total, the algorithm uses at most non- 
deterministic bits for some constant d, runs in time at most 2"/n and decides L correctly on S" . 
By choosing k > dk' , we get the desired contradiction. □ 

Williams' work still leaves open whether NEXP C SIZE(po/y). Using the same ideas as in the 
proof of Theorem 1321 we can show that an algorithm for CircuitSAT that improves slightly on brute 
force search robustly often would suffice to get such a separation. 

Theorem 33. If for each polynomial p, CircuitSAT can be solved in time 2"~'^('°s(")) robustly often 
on instances where the circuit size is at mostp{n), then NEXP 2 SIZE(po/y). 

4.3 Time-Space Tradeoffs 

Proposition 34. Lett andT be time- constructive functions such thatt = o{T). Then NTIME(T) ^ 
i.o.coNTIME(t). 

Theorem 35. Let a < \f2 be any constant. SAT r.o.DTISP(n", polylog(n)). 

Proof in the appendix. Similar ideas can be used to show the best known time-space trade- 
offs for SAT - the key is that the proofs of these tradeoffs proceed by indirect diagonalization, 
using the contrary assumption and polynomial padding a constant number of times and deriving a 
contradiction to a strong hierarchy theorem. 

5 Conclusion and Open Problems 

Our paper makes significant progress in remedying one of the main issues with proofs using indirect 
diagonalization - the fact that they don't give almost everywhere separations. We have shown that 
most interesting results proved using this technique can be strengthened at least to give significant 
separations. 

There are still many separations which we don't know how to make significant: eg., the main 
results of [BFS091 ISan07t fBFTQS] . The reasons why we're unable to get significant separations are 
different in different cases: the inability to formulate the proof as following from a single assumption 
about robustly often simulations in the first case, the use of superpolynomial amount of padding 
in the second, and the fact that complete languages for MAEXP are unknown in the last. It's not 
clear whether there are inherent limitations to getting significant separations in these cases. 

Other variants of robustly often might be interesting to study, such as a "linear" variant where 
the simulation is only required to hold on arbitrarily large linear stretches of inputs rather than 
polynomial stretches. Separations against this notion of simulation would be stronger than signifi- 
cant separations. 
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Appendix 



Here we give proofs omitted from the body of the paper. 

Proof of Lemma\^ Let / be a polynomial-time honest m-reduction from L' to L. By assumption, 
there is a robust S such that L G C on 5. Let if G C be a language such that L„ = Kn for all 
n £ S. We define a robust refinement S' of S as follows: n' £ S' iS n' £ S and for all x of length 
n' , G S. By definition, S" is a refinement of S*; we show that it is robust and that L' G C on 

S'. 

First, we show robustness of S'. Robustness of S is equivalent to saying that for each positive 
integer k, there is a positive integer m(k) such that n £ S for all m{kY/^ ^ n ^ m{k)^. Since 
/ is an honest reduction, there is an integer c > 1 such that for all x, \x\^^^ ^ 1/(2^)1 ^ l^l'^- 
We show that for each positive integer k, there is a positive integer m'{k) such that n' £ S' for 
all m'{k)^^'' ^ n' ^ m'{k)^. Simply choose m'{k) = m{ck). We have that for any n' such that 
m{ckY^^ ^ n' ^ m{ck)^ , for all x of length n', is between {n'Y/'^ and {n'Y by assumption on 

/. Hence for all x of length n', is between m{ckY/^^ and m{cky^ , which implies f{x) £ S 

for all such x, and hence n' £ S' . 

Next we show L' G C on S' . Define a language K' as follows: x £ K' iS f(x) £ K. Since C 
is closed under poly-time m-reductions, K' £ C. Now, on each input length n' £ S' , for any x of 
length n', G S, and hence L{x) = K{x). This implies that L'{x) = K'[x) for all such x, and 

hence L^, = K'^,, which finishes the proof. □ 

Proof of Theorem\l(A We show that for any positive integer k, C r.o.P. The proof is by induc- 
tion on k. We will need to formulate our inductive hypothesis carefully. 

By assumption, SAT G r.o.DTIME(n'^) for some integer c > 0. Let S be a robust set such that 
SAT G DTIME(n^) on S. Using the same idea as in the proof of Lemma O we have that for any 
L £ NTIME(n'^), L £ DTI ME (n'^'^) on Sd, where Sd is the canonical refinement defined in Definition 
m Moreover, the conclusion holds even if the assumption is merely that L £ NTIME(n'^) on Sd- 

Now we formulate our inductive hypothesis H^. The hypothesis H/^ is that T^i^SAT £ DTIME(n'^''^°'^ ) 
on S^k+i. For k = 1, the hypothesis holds because by assumption SAT G DTIME{n^) on S and 
hence on 5^2 since 5^2 is a refinement of S. If we prove the inductive hypothesis, the proof of the 
theorem will be complete using Lemma [5] and the fact that — SAT is complete for under 
polynomial-time honest m-reductions. 

Assume that holds - we will establish H^+i- Since Hk holds, we have that Ti^SAT £ 
DTIME(n'^''"^°^'^) on S^k+i. Now T^k+iSAT £ NTIME(ni+°(^))^'=^^^. Moreover, by using padding, 
we can assume that that all the queries of the oracle machine are of length n^+°(^\ Now, using the 
same idea as in the proof of LemmaO we have that Sfc+iSvlT G NTIME(n^''^°'^') on S^k+2. Using 
again the assumption that SAT G DTIME(n'^) on S',we have for each language L £ NTIME(n'^''^° ^ ) 
on S^k+i, L £ DTII\/lE(n'^*''^^^°'^') on S^k+i and hence on S^k+2 since S^k+2 is a refinement of S^k+i. 
Thus we have that Ti^+iSAT £ DTIME(n'^*^^^°'^') on S^k+i, which establishes H^+i and completes 
the proof of the theorem. □ 

Proof of Lemma \13[ We follow the usual proof of the Karp-Lipton theorem. Let {C„} be a sequence 
of circuits such that C„ solves SAT correctly for n G S and |C„| = 0(n'^). Using self-reducibility 
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and paddability of SAT, we can define a sequence {C^} of circuits such that outputs a satisfying 
assignment for all satisfiable formulae of length n G S, and |C^| = 0{n^~^^) for all n. 

Now let (p be an instance of II2SAT: cp G II2SAT iff yx3y(j){x,y). By N P-completeness and 
paddability of SAT, there is a polynomial-time computable function / such that (p 6 II2SAT 
iff Vx/(< (f>,x >) G SAT, and \z\ ^ ^ |2;|"^"*'°*^"'^\ Consider the following S2 algorithm 

for (p: it existentially guesses a circuit C of size 0{n^^^) and universally verifies for all x that 
(p{x,C'{f{< (p,x >))) holds. This algorithm decides 1125' AT correctly on all n G ^2, where 5*2 is 
the canonical refinement of S at level 2. The time taken by the algorithm is 0{n''^^^°^^^), which 
gives the desired conclusion. □ 

Proof of Theorem \18[ Let k > 1 he a constant and L be a complete set for NE under linear-time 
reductions for which there is a robust set S such that L G SIZE(n'^) on S. This implies that there 
is a robust refinement S' of S such that NE C SIZE(n'^) on S', using Lemma [H Using Lemma \TE\ 
there is a robust refinement S" of S' such that E C MATIME(n^'^) on S". Using Proposition [71 we 
have that there is a robust refinement S'" of S" such that DTIME(2"'"') C MATIME(n^'=') on S'". 
Now set R = S'" in Lemma [TTl 

There are two cases. Case 1 is that we have NE C DTIME(2"' ) on S". In this case, by using 

padding and applying Proposition [71 we have that NE C DTIME(2""'' ) C MA on 5'"g^,4^-^. This 
gives that NE C r.o.MA, which implies NEXP C r.o.MA by applying Proposition [7] again, and we 
have the desired conclusion. 

Case 2 is that MATIME(n^'^'') C NE/0(n) on some robust refinement S"" of S'" . We wiU 
derive a contradiction in this case. Since S"" is a refinement of S'" , we have that DTIME(2" ) C 
MATIME(n4'^'') C NE/0(n) on S"". Since S"" is a refinement of S", we have that NE C SIZE(n'^) 
on S"" . Applying Proposition [9l we have that there is a robust refinement S'"" of S"" such that 
NE/0(n) C SIZE(n'=) on S'"". Thus DTIME(2"'*) C r.o.SIZE(n'=), but this is in contradiction to 
the fact that DTIME(2""'') ^ i.o.SIZE(n'') by direct diagonalization. □ 

Proof of Theorem \19l Assume, to the contrary, that there is an infinitely-often robust simulation 
of NEXP by NP. Let L be a language which is paddable and complete for NE under linear-time 
m-reductions. By assumption, there is a robust set S and an integer k such that L G NTIME(n'^) 
on S. 

Let be a set in DTIME(2" ) but not in i.o.NTIME(n ) - such a set can be constructed by 
direct diagonalization. Consider the following padded version K' oi K: y £ K' iS y = xOl'^' 
for X £ K. Since K G DTIME(2" ), we have that K' £ EC NE. Now using the assumption on L 
and the proof idea of Lemma [H we have that K' G NTIME(n'^) on 5*2, where 52 is the canonical 
refinement of S at level 2. Since there is an m-reduction from K to K' running in time 0{v?^) 
which only blows up the instance length, we can use the proof idea of Lemma [5] again to show that 
K G NTIME(n2'= ) on ^4^. Now, since G NE and L is complete for NE, we can use the proof of 
idea of Lemma [5] a third time to show that K G NTIME(n'^) on ^4^. But since S^k is infinite, this 
implies K G NTIME(n'^) on an infinite set of input lengths, which contradicts our assumption on 
K. 

□ 



Proof of Theorem 24 Assume, contrarily, that Eg C r.o.SIZE(n ). Let L be a set that is complete 



for E2 — TIME(n'^'^ ) under linear-time reductions, and 5 be a robust set such that L G SIZE(n'^ 
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on S. Hence also Tj2SAT G SIZE(n'^) on S. This implies SAT G SIZE(n'^) on S, and by Lemma 
[m there is a robust refinement S' of 5 such that U2SAT G S2 - TIME(n*-'+°(i)) on S'. Now, 
by using the proof idea of Theorem [TOl we have that there is a robust refinement S" of S' such 
that ^4^3 AT G S2 - TIME(n^'+°(^)) on S". Using the fact that J^^SAT is complete for 
and the proof idea of Lemma [5l we have that there is a robust refinement S'" of 5" such that 
S4 - TIME(n3^) C S2 - J\ME{n^^*+°'-^^) on 5"'. Now, by completeness of L for S2 - TIME(n4'=*), 
we have that there is a robust refinement S"" of 5"' such that S2 - TIME(n3'=*+''(i)) C SIZE(n'=) 
on S"". This imphes S4 - J\ME{n^^) C SIZE(n^) on S"" , which contradicts Theorem [23] since S"" 
is an infinite set. □ 



Proof of Theore'm\35[ Assume, to the contrary, that SAT G r.o.DTISP(n", polylog(n)) on S for 
some robust set S and constant a < \/2- Since DTISP(n°,polylog(n)) C U2 - TlME(n"/2+«(i)) 
|FLvMV05] and using that SAT is complete for NTIME(npolylog(n)) under quasilinear-time length- 
increasing reductions, we have that there is a robust refinement S' of S such that NTIME(n) C 
DTISP(n",polylog(n)) C n2 - TIME(n"/2+o(i)) on S' . By padding, there is a robust refinement 
S" of S' such that NTIME(n2) C n2 - TIME(n"+°(^)) on S" . By using the assumption that 
NTIME(n) C DTIME(n'*'^'^'*) on 5' again to eliminate the existential quantifier in the 112 simulation, 
we have that there is a robust refinement S'" of S" such that NTIME(n^) C coNTIME(n" +°(^)) on 
S'" . But this is a contradiction to Proposition 1341 since S'" is infinite. □ 
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